NECESSARY CONDITIONS INVOLVING LIE BRACKETS 
FOR IMPULSIVE OPTIMAL CONTROL PROBLEMS; 
- THE COMMUTATIVE CASE^ 
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O: 

■ Abstract. In this article we study control problems with systems that 

are governed by ordinary differential equations whose vector fields de- 
pend linearly in the time derivatives of some components of the control. 
The remaining components are considered as classical controls. This 

. kind of system is called 'impulsive system'. We assume that the vector 

■ fields multiplying the derivatives of each component of the control are 

commutative. 

We use the results in Bressan and Rampazzo 4; where it is shown that 
the impulsive system can be reduced to a classical system of ordinary 
differential equations via a transformation of variables. The latter is 
used to give a concept of solution of the impulsive differential equation. 
In they also provide maximum principles for both the original 
" , and the transformed optimal control problems. From these principles, 

■ we derive new necessary conditions in term of the adjoint state and the 
I Lie brackets of the data functions. 

O ■ 1. Introduction 

CN ■ In this article we investigate necessary optimality conditions for a Mayer 

governed by the system 

m 

X: (1) x{t) = f{x{t)Mt),a{t)) + Y,Ux{t)Mm\t), 

(2) (a;,«)(0) = (xcuo), 

where t G [0,r], x{t) G M", u{t) G [/ C M™ and a{t) £ A C The 
detailed hypothesis concerning the control sets and the vector fields are 
given in Assumptions [1] and [2] afterwards. Consider the vector fields /, ga ■ 
W xU ^ 11"+"" for a = 1, . . . , m, defined by 

(3) f = P^, 9a=9i^ + 
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where we have adopted the Einstein summation convention. Latin indexes 
run from 1 to n and Greek indexed run from 1 to m. The columns represen- 
tations of these vector fields are 



(4) 



where is the a— th. element of the canonical basis of M™. The following 
hypothesis holds true along all the article and is of main importance. 

Assumption 1 (Commutativity). We assume that the vector fields ga com- 
mute, i.e. for every pair a, /3 = 1, . . . ,m, 

(5) [9a, 9/3] = 0, 

where [9a, 9(3] is the Lie bracket of ga and Qf^ defined by 





(f'\ 




r9i\ 


f = 




9a = 


-91 













^ ) 







(d9R ■ 

[9a, 9 p] = I -Q^9a 



\9(3 "T 



d 



Notice that [ga,9i3] has zero z-components, since all the ga have constant 
z-components. The column representation of [ga,9i3] is 



Va;5a 9/3 " Va;5/3 (ja + 





dga _ dgp 
dUji dua 



The main result of the present paper is the one stated next and it is 
proved in Section [6l Assume for the moment that p is the adjoint state and 
that it can be defined as in the classical framework. 

Theorem (Necessary conditions involving Lie brackets). Let (x* ,u* ,a*) be 
optimal for V , and leti = 1, . . .m be an index. Then the following statements 
hold. 

(i) Let t G [0, T) be any time such that there exists a > sufficiently 
small such that u*{t) + ae^ G U a.e. on [t,T]. Then 

(6) p{tygi{x*{t),u*{t)) <0. 

Furthermore, for a. a. t £ [0,T], it holds: 

(ii) If there exists ctq > sufficiently small such that u*{t) + ere; G U for 
all a G [0, fJo], then 

(7) p{ty[g,J]{x*{t),u*{t),a*{t))>0. 
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(iii) // there exist h G M™ and ctq > sufficiently small such that u*{t) ± 
ae-i € U for all a E [0, fio], then 

m 

(8) p{ty hM9v[9k,f]]ix*{t),u*{t),a*{t))>0. 

j,k=i 

In other words, 

(9) h'^Qh > 0, 

where Q is a symmetric matrix with entries 

Qjkit) := Pity [gj , [gk , f] ] {x* {t),u* (t) ,a*{t)). 
Here all the Lie brackets are computed in the variable (x,n). 

There is a wide literature concerning impulsive control systems, and many 
different approaches can be identified. In [13J Rishel derived necessary con- 
ditions for a problem with a scalar positive Radon measure as control, and 
in which the trajectories are of bounded variation. In order to deal with 
the impulsive differential equations, Rishel used the technique of 'graph 
completion' that was formalized later by Bressan and Rampazzo in [5j. In 
the latter article they dealt also with vector controls. The method of graph 
completion wa employed to obtain optimality conditions in Silva-Vinter ^^tj , 
Pereira-Silva [H], Miller [10], Arutyunov et al. [2j, among many others. 

Here we consider problems that admit trajectories of unbounded varia- 
tion. More precisely, the impulsive controls are no longer taken in the space 
of bounded variation, but in L} . The concept of solution we use is the one 
given in Bressan [3j for the scalar control case and [4] for the vector case. 
They used a change of coordinates to transform the original system into a 
simple one where that could be regarded as a classical differential equation. 
A similar procedure has been used independently by Dykhta in [6j. We ex- 
tend the Maximum Principle in [4] to a formulation that includes a classical 
bounded control, and we obtain some higher order necessary conditions in 
terms of Lie bracket of the data functions. 

The article is organized as follows. In Section [2] we present the main 
assumptions, the definition of solution of an impulsive system and some 
properties. In Section [3] we define the transformed optimal control prob- 
lem. In Section [3] we analyze the impulsive adjoint equation. We present a 
maximum principle in [5] and we derived necessary condition in [6l 

2. A NOTION OF SOLUTION 
Consider the system ([I])- ([2]) written in its augmented form 

(10) = f{x,z) + Y,eg,{x,z), 

^ ^ i=i 

(11) (x,z)(0) = (xo,no). 
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where we added the dependent variable z for the sake of simphcity in the 
presentation that follows. 

Assumption 2 (on the vector fields and control sets). (i) U C M'" is 

the closure of a connected open set. 

(ii) A C is compact. 

(iii) For every a ^ A, /(•, •, a) : R" x [/ — ^ M" x [/ is locally Lipschitz; 
and for every {x,u) £ R'", one has that f{x,u, ■) : A ^ R" x U is 
continuous. 

(iv) There exists M > such that \ f(x,u,a)\ < M(l + n)|), for every 
{x, u) G R" X U. 

This assumption guarantees the existence and uniqueness of the solution 
of the Cauchy problem ()10p - ()lip for any initial condition xq € M", u £ 
C^(0, T; U) and a G ^^(0, T; A). Moreover, for every M > 0, there exists iV > 
such that if \xq\ + ||u||oo < M then ||x(xo, a)||oo < Here x{xQ,u,a) 
denotes the unique solution of (fTO]l - (fTT]l associated to (xo,n, a). 

Now we aim to give a definition of solution of the Cauchy problem (jiop - 
(jlip for controls u £ L} . But in it can occur that two functions u and 
V are the same but m(0) ^ v{Q), and hence, special attention has to be 
payed. With this end, we introduce the concept of pointwise defined in the 
definition below. We consider not only the time t = 0, but any subset of 

[o,r]. 

Definition 2.1. (i) Let I C [0,T]. We say that two measurable maps 
z,y : [0, T] R'^ are /-equivalent if they coincide on every point 
of I and almost everywhere on [0,r]\/. The class of equivalence of 
such maps is referred as pointwise defined on /. We can identify a 
class of equivalence with one of its representatives as in the standard 
case. 

(ii) If F C M.'^j we use Lj(0,T;F) to denote the subset of Lebesgue- 
integrable maps which are pointwise defined on I and take values in 
F . We say that a sequence (y^) C L\ converges in L\ to y, ifyk^y 
in and yk{t) y{t) for every t £ L 

Definition 2.2 (Generalized solutions pointwise defined on a subset /). 
Let I C [0, r], with £ I. Consider xq £ R", and controls u £ Lj{0,T;U) 
and a £ L^{0,T; A). A function t i-^ {x{t), z{t)) of class L\ is a solution 
of (llOp pointwise defined on / corresponding to the input (xo,u,a) if there 
exists a sequence of controls (uk) C C^{[0,T],U) such that the functions 
(x(a, tifc, •), Zfc(-)) have uniformly bounded values and converge to (x,n) in 
L\. 

In what follows we prove that the Definition 12.21 is a good definition. In 
other words, we show that under the Assumptions [T] and [2] there is a unique 
generalized solution in L^ of the Cauchy problem (llOp - pip for each initial 
condition (xq, uq) and control (u, a) £ L^ x L^. Moreover, we prove that this 
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concept of solution is robust, i.e. it is continuous with respect to the initial 
conditions and the controls u and a. 

The technique is introducing a diffeomorphism that transforms the equa- 
tion (I17p into one where the impulsive part u has constant coefficients. Af- 
terwards, the results of existence, uniqueness and continuity are proved for 
this simpler transformed case. Finally, it is shown that the same result holds 
for the general equation ([T]) by transformation. 

2.1. A Change of Coordinates. Let us introduce a change of coordinate 
<j) in the product space M" x U that sends each vector field ga into the vector 
d 

field — — . This has the advantage that in the resulting system the derivative 

ii multiplies constant vector fields. 

For every j = 1, . . . , n, let ip^ : R" x ?7 ^ M be given by 

(12) ^ {x, z) = W ( exp (-z'^gu) (x, z)) , 

where Pr-' : — )• M denotes the canonical projection on the j— th. co- 
ordinate. Set (f = ((/9^, . . . (/j") and consider the map </) : M" x [/ — ^ R" x i7 
defined by 

(13) (l){x,z) = {ip{x,z),z). 

Lemma 2.1. The mapping (/) is a diffeomorphism o/R" x U into itself. 
Proof. □ 



The vector fields change with the differential of (j), i.e. for each a = 
1, . . . ,m, the transformed / and ga at (^, r]) = (j){x, z) are given by 

(14) F{C, r], v) := V(/)(x, z) f{x, z, v), Ga{t r]) := V(f){x, z) ga{x, z). 

Lemma 2.2. For every a = 1, . . . , m one has 

^' = 

Proof. See Lemma 2.1 in [2]. 

□ 

Remark 2.1. Lemma \2. 2\ just stated is actually the Simultaneous Straight- 
ening Out Theorem for commutative vector fields. The latter states that one 
can find a change of coordinates that transform a finite family of commu- 
tative smooth vector fields into constant vector fields. It is also known as 
Flow-box Theorem (see e.g. Abraham et al. [IJ or Lang [9\). 

On the other hand, notice that the last m components of F are zero. 

fF\ 

More precisely, F can be written as -F = I q I with 
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Consider hence the differential equation 

, . m = Fm,r]it),ait)), 

^ ' m = u{t), 

with the initial conditions 

The following lemma states the equivalence of the system (jlO|) - (jlip and 
the system obtained after the change of coordinates (p for measurable a and 
smooth u. 

Lemma 2.3 (Equivalence of the equations for smooth u.). Let {x,z,u,a) 
be a solution of the Cauchy problem ()10p -()li p with u € C^(0,T;C/) and 
a€L^(0,T;A). Then (^,7], u, a) with 

(19) (C,77)(t) ■.= <Pixit),zit)) 

is solution of pT|) - p^ . Conversely, if {^,r],u,a) is solution of (fT7|) - (fT8|) 
with u £ (0, T; U) and a £ (0, T; A) , then {x, z,u,a) is given by 

(20) ixit),zit)) :=0-i(^(t),r/(t)) 
is solution of (fTOjl -ffTTI). 

Proof. The result follows immediately from the definition of F and Gj. □ 



Observe now that in (jl7p the impulsive part appears with a constant 
coefficient equal to 1. Hence, for every u £ L^, (jl7p can be regarded as 
a classical differential equation by simple integration. More precisely, we 
consider ^ 

Tj = u, C{t)=m+ f F{Cis),7]{s),a{s))ds. 



Theorem 2.4 (Robustness for smooth u). (i) The function 

is continuous from L^{0,T;A) to L^(0, T; M"), for each xq G M", 
u G C^{0,T;U). 

(ii) For r > and W C C^{0,T;U), let K' C M" suc/i iftai ifte tra- 
jectories 6.(^0, u, a) have values inside K' for all ^ Br{0),u G 
W, a G L^{0,T; A). Then there exists M > such that for every 
Co,io G Br{0) and u,u€W, 

mo,u,a){T)-C{io,u,a){T)\+ [ mo,u,a){t) - ^{io,u,a){t)\dt 



(21) 

< M[\Co -io\ + \u{0) - uiO)\ + |n(r) - n(r)| + / \u{t) - u{t)\dt] , 
uniformly in a £ L^{0,T; A). 
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In the proof of Theorem 12.41 we use the following result, which is a conse- 
quence of the Banach-Caccoppoli's 

Lemma 2.5. Let X he a Banach space, M a metric space, ^ : M x X ^ X 
be a continuous function such that 

(22) \\^{m,x) - ^{m,y)\\ < L\\x - y\\, for all m e M, x,y £ X, 

with L < 1. Then the following assertions hold. 

(a) For every m E M, there exists a unique x(m) such that 

(23) x{m) = ^{m, x{m)). 

(b) The map m i— )• x{m) is continuous, and one has 



(24) 



\x{m) — x{m') II < 



1 



l-L 



\^{m,x{m)) — ^{m' ,x{m') 



Proof, [of Theorem 12. 4j Assume for the moment that F is globally Lipschitz 
in (^,??) with constant L. Fix r € [0, T], and consider the mapping 



(25) 



+ 



Fiiis), r]{s),a{s))ds + W " «"(0)]e 



a=l 



for {^o,rio,u,a) G M := R"+™ x C^{0,T;U) x L^{0,T;A) and (^,77) G X : = 
C^(0,r;M") xC^{0,T;U) with the norm 



-4TL 



(26) 



4L 



cor) + 



-AtL 



uj{t)\dt. 



Observe that if (^, rj) = x(Co5 u, a, ^, ry), then (,^, 77) is solution of (fT7|) - p^ 
with initial condition (^O) Then we are interested in applying Lemma [23] 
to X- 

Let us prove that x is continuous. Take two points i^,o,rjo,u,a,(,,r]) and 
(^Q,r]o,u,a,(,,fi) in the domain. One has the following estimations 

\\x{^o,Vo,u,a,^,r]) - x{^o,Vo, u,a,i,'n)\\x 



-ATL 



4L 



iF{Cis),v{s),ais)) - Fiii.s),f,{.s),ais)))ds 



(27) 



+ 



-AtL 



(F(^(s), ry(s), a(s)) - F{iis),fiis), a(s)))d5 



dt 



< 



<- 



^-ATL (,-^TL 



+ 



4 -4 



34 ) / \m,ri{s))-m,vis))\ds 
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and 
(28) 



\x{^o,Vo,u,a,t'n) - x{^o,Vo,u,a,tv)\\x 



4L 



+ 



+ 



+ 



eo-eo 

m - m 
t 

-UL 











+ / {F{i{s),f,{s),a{s))-F{i{s),'n{s),a{s)))ds 



{F{i{s),fi{s),a{s)) - F{i{s),f^{s),a{s)))ds 







-ATL 
T 



E 



-UL 







t m 



'(0)-ti-(r) + n"(0))e„+, 



'(0)-tl"(s) + u"(0))e„+,ds 



a=l 



dt. 



Thus, for each {^Q,fjQ,u,a,^,fi) and for every e > 0, there exists 6 > such 
that if 

\i^o,m)-{io,fio)\ + \u{o)-um 

+ \u{t) - u{t)\ + \\u - u\\i + \\a - a\\i + - < 5 



then 



and hence x in continuous. Observe that the modulus of continuity does not 
depend on r, but on \u{t) — u{t)\ and, therefore, the same estimation holds 
for every r S [0, T]. Moreover, in view of (f27|) . the inequality ([22]) holds as 
well. Therefore we can apply Lemma [2.5l to x which yields the desired result 
for F globally Lipschitz. 

In case F is only locally Lipschitz, define 

F onK' X U, 
on {K' X Uy, 



and follow previous procedure. The desired result follows. 



□ 



2.2. Properties of the impulsive system. The analogous of Theorem l2.4l 
can be proved for the impulsive system (llOp by means of the transformation 
(j). Hence we get the following result. 

Theorem 2.6. (i) The function a{-) x{xo,u, a) {■) is continuous from 
L^{0,T;A) to L^(0,r;IR"), for each xq G M", u (£ C^{0,T;U). 
(ii) For r > and W C C^{0,T;U), let K' C M" such that the tra- 
jectories x{xo,u,a) have values inside K' for all xq G Br{0),u e 
W, a € L^{0,T;A). Then there exists M > such that for every 
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xqjXq G Br{0) and u,u ^ W, 



\x{xo,u,a){T) — x{xo,u,a){T)\ + / \x{xo,u,a){t) — x{xo,u,a){t)\dt 

(29) 

< M[\xo - xo\ + \u{0) - u{0)\ + |n(r) - u{t)\ + / \u{t) - u{t)\dt] , 



uniformly in a £ L^{0,T; A). 

From previous Theorem 12. 61 and Definition 12 . 21 we get the following result. 

Corollary 2.7. For each {xo,u,a) G M" x L|Q^(0,r;C/) x L'^{0,T;A), there 
exists a unique generalized solution ^ G L|q|(0, T; M"), r/ = u, of the impul- 
sive Cauchy problem (I10p -()lip. 

2.3. Generalized solution pointwise defined everywhere. In the case 
where u is defined pointwise on [0, T], the trajectory x(xo, u, a)(-) can also be 
determined pointwise following the procedure described next. Let r G [0, T], 
and consider a sequence {wj.) C C"^ such that wj,{fi) = u(0), wJ.{t) = u(r) 
and tt;^ — )■ M in L^{0,T;U). The estimate (pOj) implies that x(xo, li^^, a)(-) 
tends to x{xQ,u,a){-) in L-"^ and that x{xo,wl.,a){T) has limit. Denote this 
limit by x(r). Note that two different sequences wj^ and yield the same 
x(t) by (j29p . Thus x is well-defined. In the sequel we prove that x is 
a generalized solution of (fTO]) - pT]) . In fact, for any t G [0, T], one can 
extract a subsequence (wj^,) from which converges pointwise to u on 
the complement of a set M of measure zero. For any r G [0,T]\AA, by (p9]) 
one has 

|x(T)-x(xo,u'^,,a)(r)| 

< |x(t) - x(xo,Wfc/,a)(r)| + |x(xo, w^^/, a)(r) - x{xo,wi,,a){T)\ 
+ / \x{xo,wl,,a){s) - x{xo,wl/,a){s)\ds 







< |2;(t) -x(xo,^x;^,,a)(r)| +M[|^i;^,(r) -4,(r)| 
+ / \wl>{s) -wi,{s)\ds]. 



JO 

The right hand-side goes to since wJ,,{t) — )• U{t). Thus, x{xQ,w\,,,a) — ?■ x 
almost everywhere. Since x{xQ,w\,^a) have uniformly bounded values, it 
follows that they converge to x in L^. Therefore, (x, z = n) is a generalized 
solution of (fTnl) - (fTT]) . 

Given xq G M", u G -^^pT] ^ ^ L^i^^T] A), there is only one solution 
{^,rj = u) of (fT71) - (fT8]) . for which ^ is an absolutely continuous function. 
Note that 

x(r) = lim x{xo,wl,a){T) 

k—^ca 

= lim <f-^{^{ip{xo,uo),wl,a){T),wl{T)) = (^"^(^(r), u(r)). 
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Hence, we get. 

Proposition 2.8. For each {xQ,u,a) G M" x L|p ^^(0, T; [/) x V-{id,T;A), 

there is a unique solution {x,z) of (fTO]) - (fTT]) that is pointwise defined in 
[0,T]. Moreover, it is given by the formula 

{x{T),z{T))=^-\aT),u{T)), for all T £ [0,T], 

where ^ € AC(0,T;M") is the unique solution of p!7|) - (fT8|) corresponding to 
(xo, u, a) and rj = u. 

Theorem 2.9 (Robustness of the impulsive system). The assertions in 
Theorem \2. (A hold when we consider the controls u in Ljq j,j(0, T; f/). 

Proof. It is a immediate consequence of Theorem 12.61 and the Definition 12.21 
of generalized solution. □ 

2.4. Statement of the Optimal Control Problem. Now we are ready 
to state in a proper way the optimal control problem we deal with. Let 
7 : R"'+"* — 7> M be a smooth function. Denote by V the (impulsive) optimal 
control problem of finding {xo,u, a) G M" x Lj^ (0, T; U) x (0, T; A) that 
minimizes 

7(x(r),z(r)), 

where (x,z) is the generalized solution of (fTO|) - (fTT]) associated to {xo,u,a). 

3. The Transformed Optimal Control Problem 

Next we introduce an auxiliary optimal control problem in the trans- 
formed variables that will be used afterwards to derive optimality conditions 
for v. Denote by V' the problem consisting of minimizing 

(30) ^(e(r),r?(r)), 

over the trajectories of the system (fT7|l - (fT8]l with controls u € L^^ j'](0, T; U). 
Here the function : M"'+'" ^ M is defined by 

(31) ^'(e,r?) :=7(r'(^,^?)). 

The following result is a straightforward consequence of Proposition 12.81 

Proposition 3.1. A triple (xo,u*,a*) G M" x Lf^ ,^](0, T; f/) x L^{Q,T;A) 

is optimal for V if and only if it is optimal for V' . Moreover, V and V' have 
the same optimal values. 

4. The Adjoint Equation 

In this section we show that the adjoint equation associated to (llOp is 
commutative. Let us first establish a technical lemma that will yield the 
desired commutativity afterwards. 
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Consider a and b two vector fields of class from to , and define 

I>2Af , Tn>2Af 



A: 

{y,w) A{y,w) — ' 



Va{y) ' -tf / ' 



and 



-Vb{y) ' -w 

Lemma 4.1. Let a, b : be two vector fields of class C^, such that 

[a,b] = 0. Then, the vector fields defined in ()32p -(p3 |) commute as well, or 
equivalently, [A, B] = 0. 

Proof. Here the Einstein notation is used, which implies summation over 
repeated indexes. For k = 1, . . . ,N, we have 

f)h Fin 

(34) [A,Bf = —a^-—b^ = [a,b]^ = ^, 

and 
(35) 

\A B]^^^ — ^^^^ a'' + ^^'^ + ^^'^^ w^b" da"" db^ 

' dy^dy^ dy^ dy^ dy'^dy^ dy^ dy^ 



dy^ \ dy^ J Sy'^ 

Thus, the result follows. □ 

Consider now the augmented system pO|) - pT]) together with its associated 
adjoint equation 

/ ■\ ™ . 

(36) ( i ) = ■^(^' ^' + X] ^'9i{x, z), 

(37) (pi,P2) = -(pi,P2) • ^V(^^„)/(3;,n,a) + ^n*V5ri(2;,n)^ , 

and the endpoint conditions 

(38) (x(0),z(0)) = (xo,no), 

(39) ipiiT),p2iT)) = VjixiT),uiT)). 

The vector fields that are coefficients of u in (|36p - (|37p are given by 

/ 9i(.x,z) 

(40) g,{x,z,p„p,):= (^^T(^^,)7pi_ 
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Applying Lemma [HT] we get that, for each pair i, j, [Qi, Qj] = since [gi^Qj] = 
0. Hence, a concept of solution equivalent to the one given for the augmented 
impulsive system (fTO]) - (fTT]) can be given to (f37l) . (f39]l . We will refer to it as 
the generalized solution of the adjoint equation. Furthermore, we can also 
relate (p6]l - (|39]l with the adjoint equation associated to the transformed 
equation (fT7l) - (fT8l) via a change of variables. With this aim, consider the 
adjoint system associated to (fT7|l - (fT8]l . 

m = F{mMt).a{t)), 

^i{t) = -vri(t)- V^rm, V{t), a{t)), 

Mt) = -vri(t)- V^F(e(0,??W,a(i)), 
with endpoint conditions given by 

C(0) = (p{xo,uo), 

(42) r/(0) = uo, 
(^i(r),^2(T)) = VvI/(e(T),r?(T)). 

Proposition 4.2 (Generalized solution of the adjoint equation). Given 
{x,z,u) a generalized solution of p^ - pT]) defined pointwise everywhere, 
let (^,7/, a, n) be its transformation through <j) and (^1,112) be the solution of 
(|4ip -(j42 p in the classical sense. Then, the generalized solution p of (|37p .p9]l 
verifies 

(43) p = vr- V0(2;,n). 

The latter result is an easy consequence of the change of coordinates. We 
pass now to the second part of the article where we provide a set of necessary 
conditions for optimality. 

5. The Maximum Principle for the Transformed problem 

We recall here two theorems due to Bressan-Rampazzo [1]. The first 
statement is Theorem 16.11 that provides a maximum principle for V, and 
it is a consequence of the second result presented in Theorem 15.11 that is a 
maximum principle for the transformed problem V' . 

Theorem 16. II is a consequence of the following result. 

Theorem 5.1 (Maximum Principle for the Transformed Problem). Let 

{^*,u*,a*) be an optimal for problem V', and let ((^*, u*), (ttJ, 7r|)) denote 
the solution of the adjoint equation (|4ip -(|42 p . Then, 

(44) TTiit) (^F{C{t),u,a) - F{e{t),u*{t),a*{t))) > 0, 

for almost every t G [0,T] and for every u € U,a (z A. Moreover, if for any 
t S [0,r], v : [t,T] —^Uisa map as in Theorem \6.1\ then 

(45) TT2{t)-v{t) >- TT2-U. 

J[t,T] 
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Remark 5.1. Actually, the conditions ()54p and (|44p hold on the set of 
Lebesgue points of (n*,a*) and hence, since (n*,a*) is a L^— function, it 
holds almost everywhere on [0,T]. 

Proof, [of Theorem I5.1j 

Observe that the classical Pontryagin Maximum Principle (see [I2j) can 
be applied to problem V' , and it yields the minimum condition (I44p . The 
latter holds at every Lebesgue point of {u*,a*) and hence, since (u*,a*) is 
in L^, (I44p holds almost everywhere on [0,T]. 

In order to prove (|45]) . let a G [0,(To] for a small positive ctq and consider 
the controls given by 



(46) 



u*{t), ifrG[0,t), 
u*{T)+au{T), ifrG[t,r]. 



Here : [t, T] — > M™ is a function satisfying the hypotheses of Theorem 16. II 
Denote ^o- the solution of the transformed system (fT7|l corresponding to Ua- 
It turns out that (see e.g. p] or [71 Theorem 10.2, Chapter II]), 



(47) 



d_ 
d^ 



cr=0-t 



where ^|^_o+ refers to the right derivative at u = and oj : [t,T] — > 

the solution of 

(48) 

\ uj{t) = 0. 



IS 



From dnj and (gH]) we get 



(49) — [{111,112) ■ {u},v)] = 7^2- i>, 

QT 

and thus, the relation 

(50) (7ri(T),vr2(r))-(a;(T),z.(r)) -(7ri(t),7r2(t))-(o;(t),Kt)) 



TT2- V 



follows. Since u* is optimal 
and therefore, 



^'(e.(r),n,(r)) >o. 



o-=0+ 



=0+ 



(52) 



v*(r(T),7x*(r))- — 

(7ri(r),vr2(r)).(a;(r),z.(r)). 



(e.(T),n^(r)) 
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Considering ([50|) we get 

(53) / 7r2Z> + (^i,7r2)-(w,z^)(t) = (7ri(T),7r2(r))-(a;(r),i.(r)) >0. 

J[t,T] 

Hence, since uj{t) = 0, we obtain the inequality (jl5]) . This concludes the 
proof. 

□ 

6. Necessary Optimality conditions 
INVOLVING Lie brackets 

Definition 6.1. For every {x,ui,a) £ M'^xL'^x^ andu2 € U, the n— dimensional 
vector 

Tuifix, Ui,a) = Vxip{ip{x, Ui - U2),U2 - Ul)- f{ip{x, Ul - U2),U2,a), 

is called the U2 — transport of f at {x,ui,a). 

Theorem 6.1 (Maximum Principle). Let {u* ,a* , x*) be an optimal control 
forV, and let {{x* , z*), {pi,P2)) denote the generalized solution of the adjoint 
system (|36l) - (f39l) . Then, 

(i) The inequality 

(54) piity (Tufix*{t),u*it),a*it)) - fix*{t),u*it),a*{t)) >0 

holds for a. a. t E [0, T] and for every u G U. 

(ii) For every a £ A and a. a. t £ [0, T], 

(55) pi{f{x*{t),u*{t),a)-f{x*{t),u*{t),a*{t))>0. 

(iii) Moreover, for any t € [0,T], let v : [t,T] ^ U be a bounded variation 
map, that is right continuous at t and left continuous at T, and such 
that (n* + o"z^)(t) € U, for a. a. r € [t,T] and for a G [0, do]. Then, 
one has 

m „ 

(56) pi{t)-y^ux*{t)x{t)y{t)+p2{t)-v{t)> P20. 

Here the integral on the right hand-side is the integral of p2 with 
respect to the vector Radon measure v. 

Theorem 6.2 (Necessary conditions involving Lie brackets). Let {x* ,u* , a*) 
be optimal for V, and let i = l,...m be an index. Then the following 
statements hold. 

(i) Let t G [0, T) be any time such that there exists a > sufficiently 
small such that u*{t) + ae^ £ U a.e. on [t,T]. Then 

(57) p{t)-gi{x*{t),u*{t)) <0. 
Furthermore, for a. a. t S [0,T], it holds: 
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(ii) // there exists (Tq > sufficiently small such that u* (t) + crej e U for 
all a € [0, do], then 

(58) p{ty[g„f]{x*{t),u*{t),a*{t))>0. 

(iii) // there exist h € and o"o > sufficiently small such that u*{t) it 
crej € U for all a € [0, fio], then 

m 

(59) p(i)- hjhk[9iA9kJ\\{x*{t),u*{t),a*{t))>Q. 

j,k=i 

In other words, 

(60) h'^Qh > 0, 

where Q is a symmetric matrix with entries 

Qjkit) := Pity [gj, [gk, /] ](x*(t), n*(t), a*(t)). 

Here all the Lie brackets are computed in the variable {x,u). 

Remark 6.1. a) Notice that the assumption on u* in item (i) is stronger 
that the ones done in (ii) and (iii). This is due to the fact that differ- 
ent control variations are employed for obtaining different necessary 
conditions. 

b) Observe that ifU = W"", then the condition (|57|) implies that at every 

te[o,T], 

(61) p{ty[g„f]{x*{t),u*{t),a*{t))=0. 

The latter condition was also obtained by Silva and Vinter in |14] . 
for the case when u is a scalar bounded variation function. 

Proof. Let i,j and t be as in the statement of the theorem. We shall start 
by proving item (i). Let : [t,T] — > be given by 

(62) = 1, i^k = for all k ^ i. 

Then v verifies the hypotheses of Theorem 16.11 For this particular v, the 
condition (156p yields 

(63) piitygi{x*it),u*it))+p2{tyei<0, 



where e; is the i—th. canonical vector in R™. Finally, notice that (j63p can 
be rewritten as (|57p and hence (i) follows. 

In order to prove (ii) recall the condition (j44p of Theorem 15.11 Set u = 
u*{t) + (TGi, and observe that implies 

(g4) ^^^^^ F{C{t),u*{t) + aei,a*{t))-FiC{t),u*{t),a*it)) ^ ^ 

a ~ 

By taking the limit as o" ^ 0^ we get 

(65) ^,(t).|^(^*(t),^*(t),a*(t))>o. 
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On the other hand, notice that 

dF dF 

Hence, ([65]) is identical to 

(67) ^(t)-[G„F](r(t),n*(t),a*(t)) >0, 

which coincides with (j58p in the original coordinates and thus (ii) is proved. 

We shall now prove (iii). First observe that for cj > sufficiently small it 
holds 

(gg) ^^^^^ F(e(t), u*{t) + aK a*{t)) - F{e{t),u*{t),a*{t)) ^ 

and the opposite inequality holds for u*{t) — ah. Thus, 
(69) 7Ti{t)VhF{C{t),u*{t),a*{t)) = 0, 

where V/j denotes the directional derivative in the direction h. Consider now 
the second order Taylor expansion 

F{Cit),u*it) + ah, a*it)) = F{Cit),u*{t),a*it)) 

+ aV^FiCit), u*{t),a*{t)) + a^Vlf,F{eit),n*{t), a*{t)) + o{a^). 

By multiplying by vri (t) and dividing by o"^ we get 
(70) 

^^-^ F{^*{t),u*{t)+ah,a*{t)) ^ ~ 
0<7ri(t) 2 = ^h.hF{^ {t),u {t),a (t)) + o(l), 

where the first inequality holds by ()44p . Taking the limit as a goes to 
yields 

(71) 7riityvlf,F{C{t),u*{t),a*it)) >0. 
Notice that 

mm m 

(72) T^rVlhF = ^-Y,hkVu,Y.h,Vu,F = 7:- ^ [G^, F]]. 

fc=l j=l j,k=l 



Equation (j72p written in the original coordinates together with the inequal- 
ity (|7ip imply (j59p . Finally, we shall prove the symmetry of the matrix Q. 



Notice that, since F is of class C^, then Vu^V^jF = ^Uj^uu^- By multiply- 
ing by TT and rewriting in the original coordinates, the symmetry follows. 
This completes the proof. □ 



The symmetry of Q follows also from the Jacobi identity and the commutativity of Qi. 
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